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VIRTUAL DATA ENTRY DEVICE AND METHOD FOR INPUT OF 
ALPHANUMERIC AND OTHER DATA 
FIELD OF THE INVENTION 
The present invention relates to apparatus and methods for inputting 
information into a. computer. 

BACKGROUND OF THE INVENTION . 
The following U.S. Patents are believed to represent the current state of 



10 the art: 
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The following patent documents are believed to be most relevant to the 
present invention: U.S. Patents 5,734,375; 5,736,976; 5,767,842; 6,031,519; 6,043,805 
20 and Published PCT Patent Application WO 00/21024. 



SUMMARY OF THE INVENTION 
The present invention seeks .to provide improved apparatus and 
methodologies for inputting at least alpha-numeric information into a computer. 

25 The present invention seeks to provide a novel and improved data input 

device. In many embodiments of the present invention, there is no physical input device 
in the usual sense of the word, rather an optical image of a data input device is 
generated. A light beam emanating from a light source (e.g., laser source) is preferably 
moved at high speed by means of a mirror array or scanner, for example, to form a 

30 two-dimensional or three-dimensional image of an input device, such as a keyboard 
with all of the keys, in which case the user presses "virtual" keys of a "virtual" optically 
generated keyboard. Another example of an optically generated input device is a 
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"virtual" mouse, wherein pressing or touching an outlined area performs a "click". Other 
examples include "virtual" musical instruments, such as an organ, a "virtual" switch, a 
"virtual" telephone touch pad, and the like. 

Preferably optical, acoustic, position or movement sensors sense the 
5 "pressing" or "striking" of virtual keys, and the sensed movement is sent to a processor 
which processes and interprets the "pressing" into the desired characters, instructions, 
information and data. The input may then be transmitted to a computer, mobile 
telephone, musical instrument, and the like. The laser and beam-moving apparatus are 
preferably housed in a unit approximately the same size as a cell phone, or even smaller. 
10 The laser and beam-moving apparatus may be provided separately from a cell phone, or 
may be a built-in unit manufactured integrally with the phone. 

The present invention is particularly advantageous for mobile 
communication devices. A user can carry any conveniently small size cell phone, for 
example, plus the equivalently-sized laser unit of the invention. If the user wishes to 
15 type messages to be sent to the Internet via the cell phone, for example, the user simply 
generates a large size keyboard with the laser unit and comfortably types the commands 
and message, without having to grapple with multiple presses of keys or with too small 
keys, or with lugging a clumsy, large . keyboard. The present invention thus enables 
user-friendly use of cell phones for communication on the Internet The same holds true 
20 for palm-sized computer/calculators or PDAs (personal digital assistants). 

The present invention also provides a multilingual keyboard. Current 
keyboards generally have at most two languages indicated on the keys, e.g., the local 
language and English. In the present invention, since the keys are "virtual", any 
language can be optically formed on the keys of the keyboard, and a suitable linguistic 
25 processor can interpret between the keyed-in language and any other language in which 
it is desired to transmit a message. 

In another aspect of the invention, the user can modify the arrangement, 
size and shape of the virtual keys. In still another aspect of the invention, a holographic 
image of all or part of the virtual keyboard can be employed. 
30 The image of the virtual keyboard can be constructed by means of a 

monochromatic laser, or a blend of differently colored laser beams, either by using 
multiple laser sources having different colors and wavelengths, or by using a single 
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laser source and using color and wavelength splitters. Differently polarized light beams 
can also be used. The keyboard of the present invention can not only be used as the sole 
data input device, but can also be integrated with other conventional or 
non-conventional data input devices. 

There is thus provided in accordance with a preferred embodiment of the 
present invention a data input device including an optically generated image of a data 
input device, the image including at least one input zone actuable by an action 
performed thereon by a user, a sensor operative to sense the action performed on the at 
least one input zone, and to generate signals in response to the action, and a processor in 
communication with the sensor operative to process the signals for performing an 
operation associated with the at least one input zone. 

In accordance with a preferred embodiment of the present invention a 
light source is provided which generates a light beam, and beam-moving apparatus is 
provided which moves the light beam to generate the optically generated image of the 
data input device. 

Further in accordance with a preferred embodiment of the present 
invention the beam-moving apparatus includes a mirror arranged to reflect the light 
beam, and an actuator operatively connected to the mirror, wherein the actuator moves 
the mirror to reflect the light beam to form at least a two-dimensional image of the data 
input device. 

Still further in accordance with a preferred embodiment of the present 
invention the beam-moving apparatus includes a scanner arranged to scan the light 
beam, and an actuator operatively connected to the scanner, wherein the actuator moves 
the scanner to scan the light beam in order to form at least a two-dimensional image of 
the data input device. . 

In accordance with a preferred embodiment of the present invention the 
data input device may include a key of a keyboard, a keyboard, a mouse with at least 
one input button or a key of a touch pad. 

Further in accordance with a preferred embodiment of the present 
invention the sensor may include an optical sensor (such as a CCD or PSD), an acoustic 
sensor or a movement sensor. 

Still further in accordance with a preferred embodiment of the present 
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invention the processor is in communication with an output device, such as a computer, 
a mobile telephone, a switch or a palm-held computer/calculator. 

There is also provided in. accordance with a preferred embodiment of the 
present invention a method for data input including generating an optical image of a 

5 data input device, the image including at least one input zone actuable by an action 
performed thereon by a user, performing an action on the at least one input zone, 
sensing the action performed on the at least one input zone, generating signals in 
response to the action, and processing the signals for performing an operation associated 
with the at least one input zone. 

10 In accordance with a preferred embodiment of the present invention the 

step of generating the optical image includes generating an image of a keyboard and the 
step of performing an action includes pressing keys defined by the image of the 
keyboard. 

Further in accordance with a preferred embodiment of the present 
15 invention the step of processing the signals causes typing alphanumeric characters on a 
computer, cell phone, palm-sized computer/calculator or PDA. 

In accordance with a preferred embodiment of the present invention the 
method further includes modifying the image of the keyboard so as to modify a 
configuration of keys of the keyboard. 
20 Additionally in accordance with a preferred embodiment of the present 

invention the method further includes optically generating an image of characters of a 
first language on keys of the keyboard, selecting a second language different from the 
first language, and optically generating an image of characters of the second language 
on keys of the keyboard. 
25 Further in accordance with a preferred embodiment of the present 

invention the optical image of the data input device is a holographic image. 

Still further in accordance with a preferred embodiment of the present 
invention the optical image of the data input device is generated by means of a 
monochromatic laser. 

30 Additionally in accordance with a preferred embodiment of the present 

invention the optical image of the data input device is generated by means of multiple 
laser sources having different colors and wavelengths. 
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In accordance with a preferred embodiment of the present invention the 
optical image of the data input device is generated by employing a single laser source 
and using color and wavelength splitters to split light from the single laser source. 

Further, in accordance with a preferred embodiment of the present 
invention the optical image of the data input device is generated by means of differently 
polarized light beams. 

In accordance with a preferred embodiment of the present invention the 
step of sensing includes detecting light reflected from an object within a silhouette of 
the image, and analyzing a reflection of the light to determine a spatial position of the 
object. 

Further in accordance with a preferred embodiment of the present 
invention the step of sensing includes providing a light beam emanating from a light 
source, detecting light reflected from an object within a silhouette of the image, 
corresponding to the light beam, and analyzing an angle of the light beam and a time for 
the beam to be reflected back from the object to a reference to determine a spatial 
position of the object 

Still further in accordance with a preferred embodiment of the present 
invention the reference includes an optically readable reference. 

Additionally in accordance with a preferred embodiment of the present 
invention the optically readable reference includes a tangible bar code strip or an 
optically generated bar code strip. 

In accordance with a preferred embodiment of the present invention the 
optical image of a. data input device is generated by the same light beam whose 
reflection is used to determine the spatial position of the object. 

Further in accordance with a preferred embodiment of the present 
invention the step of sensing includes providing a non-visible-light beam emanating 
from a non- visible-light source, detecting an image of the non-light impinging upon an 
object within a silhouette of the image of the data input device, and analyzing the image 
of the non-light to determine a spatial position of the object. 

Still further in accordance with a preferred embodiment of the present 
invention the non-visible-light beam includes an infrared beam and the image of the 
non-light includes an infrared image of the object. 
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In accordance with a preferred embodiment of the present invention the 
object includes a finger and the step of analyzing includes analyzing a difference in the 
infrared images of the finger before and after pressing the finger. 

Further in accordance with a preferred embodiment of the present 
5 invention the method includes detecting light reflected from an object within a 
silhouette of the image and preventing the image from impinging upon the object. 

There is additionally provided in accordance with a preferred 
embodiment of the present invention apparatus for inputting at least alpha-numeric 
information into a computer including: 
10 a projector, projecting an image of at least part of a keyboard onto an 

inert surface; 

at least one sensor, sensing user indicator interaction with specific 
locations on the image of at least part of a keyboard; and 

at least alpha-numeric information generation circuitry employing an 
1 5 output from the at least one sensor for providing an at least alpha-numeric output. 

Preferably, the apparatus also includes a wireless communicator 
operative to provide the at least alpha-numeric output in a wireless manner to a receiver. 
Preferably, the wireless communicator includes a cellular telephone or a personal digital 
assistant. 

20 In accordance with a preferred embodiment of the present invention, the 

cellular telephone includes a housing, in which housing are mounted the projector, the 
at least one sensor and the at least alpha-numeric information generation circuitry. 

In accordance with a preferred embodiment of the present invention a 
personal digital assistant includes a housing, in which housing are mounted the 

25 projector, the at least one sensor and the at least alpha-numeric information generation 
circuitry. 

Preferably, the at least one sensor includes at least one infra-red or 
visible illuminator, directing infra-red or visible radiation over the image of at least part 
of a keyboard onto an inert surface and at least one infra-red or visible sensor for 
30 sensing infra-red or visible light scattered from at least one user indicator. 

In accordance with a preferred embodiment, the user indicator is a user 
finger or user held stylus. 
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In accordance with a preferred embodiment, the projector includes a 
point light source illuminating a mask defining the image of at least part of a keyboard. 

Preferably, the apparatus also includes a mirror directing light passing 
through the mask onto the inert surface. Preferably, the apparatus also includes at 
5 least one lens directly light from the point source through the mask. 

In a preferred embodiment the point light source includes a diode laser. 

Preferably the mask is formed to define a distorted representation of the 
image of the at least part of a keyboard in order to compensate for distortions in the 
projector. 

10 In another preferred embodiment the mask is a dynamically changeable 

mask. 

In another preferred embodiment the infra-red illuminator includes a 
cylindrical reflecting element receiving light from a point source and producing a 
generally flat, generally radially-directed light distribution. 
15 In another preferred embodiment at least one sensor includes an array of 

discrete sensing elements and at least one lens operative to image a region overlying 
each of a plurality of keyboard locations onto a corresponding at least one of the array 
of discrete sensing elements. Preferably, the at least one sensor includes an a position 
sensitive detector and at least one lens operative to image a region overlying each of a 
20 plurality of keyboard locations onto a corresponding region on the position sensing 

detector. 

In another preferred embodiment the at least one infra-red illuminator is 
operative to direct infra-red radiation at a plurality of levels over the image of at least 
part of a keyboard and the at least one infra-red sensor is operative to sense infra-red 
25 light scattered from at least one user indicator at a plurality of locations therealong. 

In another preferred embodiment the projector includes a diffractive 
optical element, which when illuminated produces the image of at least part of a 
keyboard onto the inert surface. 

Preferably the projector includes a spatial light modulator, which when 
30 illuminated produces the image of at least part of a keyboard onto the inert surface. 

Preferably the spatial light modulator includes a dynamic spatial light 
modulator which is responsive to an electrical input for producing a dynamic image 
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onto the inert surface. 

There is additionally provided in accordance with a preferred 
embodiment of the present invention apparatus for wireless system for web browsing 
including: 

5 a wireless communicator providing web browsing functionality: and 

at least one projector mounted on the wireless communicator and 
projecting an image of a display onto a surface. 

Preferably the apparatus also includes projecting an image of at least part 
of a keyboard onto a surface. 
10 In accordance with another preferred embodiment of the wireless system 

for web browsing the apparatus includes: 

a wireless communicator providing web browsing functionality; 
at least one projector mounted on the wireless communicator and 
projecting an image of at least part of a keyboard onto a surface; 
15 at least one sensor, sensing user indicator interaction with specific 

locations on the image of at least part of a keyboard; and 

at least alpha-numeric information generation circuitry employing an 
output from the at least one sensor for providing an at least alpha-numeric output. 

Preferably the projector is also operative for projecting an image of a 
20 display onto a surface, whereby a user may readily view images produced during web 
browsing. 

In another preferred embodiment there is provided a wireless system for 
web browsing which also includes: • 

at least one sensor, sensing user indicator interaction with specific 
25 locations on the image of the display; and A 

web browsing input circuitry employing an output from the at least one 
sensor for providing an at least one web browsing output based on user implement 
actuation of locations on the image of the display corresponding to web links. 

In another preferred embodiment there is provided a wireless system for 
30 e mail communication which also includes: 

a wireless communicator providing e mail communication functionality; 

and 
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at least one projector mounted on the wireless communicator and 
projecting an image of a display onto a surface. 

In accordance with another preferred embodiment of the present 
invention there is provided a wireless system for e mail communication which also 
5 includes: 

a wireless communicator providing e mail communication functionality; 

at least one projector mounted on the wireless communicator and 
projecting an image of at least part of a keyboard onto a surface. 

Preferably the wireless system for e mail communication also includes: 
10 at least one sensor, sensing user indicator interaction with specific 

locations on the image of at least part of a keyboard; and 

at least alpha-numeric information generation circuitry employing an 
output from the at least one sensor for providing an at least alpha-numeric output. 

Preferably the wireless system for e mail communication is also 
15 operative for projecting an image of a display onto a surface, whereby a user may 
readily view messages during e mail communication. 

Preferably the wireless system for e mail communication also includes 
at least one sensor, sensing user indicator interaction with specific locations on the 
image of the display; and e-mail communication input circuitry employing an output 
20 from the at least one sensor for providing an at least one e mail communication output 
based on user implement actuation of locations on the image of the display. 

In accordance with another preferred embodiment of the present 
invention there is provided a wireless system for mobile commerce communication that 
also includes: 

25 a wireless communicator providing mobile commerce communication 

functionality; and 

at least one projector mounted on the wireless communicator and 
projecting an image of a display onto a surface. 

Preferably the wireless system for mobile commerce communication also 

30 includes 

at least one sensor, sensing user indicator interaction with specific 
locations on the image of at least part of a keyboard; and 
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. at least alpha-numeric information generation circuitry employing an 
output from the at least -one sensor for providing at least an mobile commerce 
communication output. 

Preferably the wireless system for mobile commerce communication is 
5 also operative for projecting an image of a display onto a surface, whereby a user may 
readily view images produced during mobile commerce communication. 

Preferably the wireless system for mobile commerce communication also 
includes: - 

at least one sensor, sensing user indicator interaction with specific 
10 locations on the image of the display; and 

mobile commerce communication input circuitry employing an output 
from the at least one sensor for providing an at least one mobile commerce 
communication output based on user implement actuation of locations on the image of 
the display corresponding to web links. 
15 In another embodiment of the present invention the apparatus includes : 

a projector that protects an image of at least part of a keyboard and of 
mouse functionality onto the inert surface; and 

the at least one sensor senses user indicator interaction with specific 
locations on the image of the mouse functionality. 
20 In another embodiment of the present invention the apparatus includes 

apparatus for inputting at least cursor-control information into a computer including: 

a projector, projecting an image of at least part of mouse functionality 
onto an inert surface; 

at least one sensor, sensing user indicator interaction with specific 
25 locations on the image of at least said mouse functionality; and 

at least cursor control information generation circuitry employing an 
output from the at least one sensor for providing an at least a cursor control output. 

BRIEF DESCRIPTION OF THE DRAWINGS 
30 The present invention will bei understood and appreciated more fully 

from the following detailed description, taken in conjunction with the drawings in 
which: 
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Fig. 1 is a simplified pictorial illustration, of a system for data input 
constructed and operative in accordance with a preferred embodiment of the present 
invention; 

Fig. 2 is a simplified block diagram of a the system for the data input 
device of Fig. 1; 

Figs. 3 A - 3E are simplified pictorial illustrations of optically generated 
images of data input devices, constructed and operative in accordance with different 
preferred embodiments of the present invention; 

Fig. 4A is a simplified pictorial illustration of beam-moving apparatus 
constructed and operative in accordance with a preferred embodiment of the present 
invention, including a mirror array with actuators for moving the array; 

Fig. 4B is a simplified pictorial illustration of beam-moving apparatus 
useful in accordance with another preferred embodiment of the present invention, 
including a crystal beam modifier; 

Fig. 4C is a simplified pictorial illustration of beam-moving apparatus 
constructed and operative in accordance with yet another preferred embodiment of the 
present invention, including a scanner; 

Fig. 5 is a simplified pictorial illustration of a data input device 
constructed and operative in accordance with another preferred embodiment of the 
present invention, including a light unit that projects an optical image of a data input 
device by projecting light from underneath a transparent or translucent substrate; 

Fig. 6 is a simplified illustration of a multilingual keyboard, constructed 
and operative in accordance with a preferred embodiment of the present invention; 

Fig. 7 is a simplified illustration of a non-standard layout of keys on an 
optically generated image of a keyboard, wherein a user can modify the arrangement, 
size and shape of the "virtual" keys, in accordance with a preferred embodiment of the 
present invention; 

Fig. 8 is a simplified illustration of an optical sensor system for sensing 
input of data in any of the data input devices of the invention, constructed and operative 
in accordance with a preferred embodiment of the present invention, which uses two 
light beams to determine the position of the object defining the data input; 

Fig. 9 A is a simplified illustration of a light beam passing over the 
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light-generated data input device of Fig. 8, with no object placed on the input zones; 

Fig. 9B is a simplified illustration of a light beam passing over the 
light-generated data input device of Fig. 8, with an object placed on one of the input 
zones; 

Fig. 10 is a simplified illustration of an optical sensor system for sensing 
input of data in any of the data input devices of the invention, constructed and operative 
in accordance with another preferred embodiment of the present invention, which uses 
one light beam to determine the position of the object defining the data input; 

Fig. 1 1 is a simplified illustration of an optical sensor system for sensing 
input of data in any of the data input devices of the invention, constructed and operative 
in accordance with yet another preferred embodiment of the present invention, wherein 
a bar code reference is used to determine the position of the object defining the data 
input; 

Fig. 12 is a simplified illustration of a sensor system for sensing input of 
data in any of the data input devices of the invention, constructed and operative in 
accordance with another preferred embodiment of the present invention, wherein a 
non-visible-light beam is used to determine the position of the data input; 

Figs. 13 and 14 are simplified illustrations of two typical infrared images 
of fingers placed upon "a " virtual" keyboard constructed in accordance with a preferred 
embodiment of the present invention; 

Fig. 15 is a simplified flow chart of a method for preventing displaying 
an image of a data input device on selected locations, in accordance with another 
preferred embodiment of the present invention; » : 

Figs. 16 and 17 are simplified illustrations of generating images of data 
input devices in accordance with two preferred embodiments of the present invention, 
wherein in Fig. 16, a web page is light-generated, and wherein in Fig. 17, a game object 
is light-generated; 

Fig. 18 is a simplified illustration of a mirror with one or more darkened 
portions for generating images of data input devices in accordance with another 
preferred embodiment of the present invention; 

Fig. 19 is a simplified pictorial illustration of a mobile telephone 
including a projected keyboard functionality in accordance with a preferred embodiment 
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of the present invention; 

Fig. 20 is a simplified pictorial illustration of a personal digital assistant 
including a projected keyboard functionality in accordance with a preferred embodiment 
of the present invention; 

Fig. 21 is a simplified partially pictorial, partially schematic illustration 
of projection, illumination, detection and information processing functionality useful in 
the embodiments of Figs. 19 and 20; 

Fig. 22 is an another illustration of the projection functionality of Fig. 

21; 

Fig. 23 is a somewhat more, detailed illustration of the illumination 
functionality of Fig. 21 in accordance with a preferred embodiment of the present 
invention; 

Fig. 24 is a somewhat more detailed illustration of the detection 
functionality of Fig. 21 in accordance with a preferred embodiment of the present 
invention; 

Fig. 25 is a simplified pictorial illustration of a pre-distorted projection 
mask useful in the functionality of Figs. 21 and 22; 

Fig. 26 is a somewhat more detailed illustration of the detection 
functionality of Fig. 21 in accordance with another preferred embodiment of the present 
invention and providing detection in three dimensions; 

Fig. 27 is a somewhat more detailed illustration of the projection 
functionality of Fig. 21 in accordance with another preferred embodiment of the present 
invention; 

Fig. 28 is a somewhat more detailed illustration of the projection 
functionality of Fig. 21 in accordance with yet another preferred embodiment of the 
present invention and providing dynamic projection; 

Fig. 29 is a simplified pictorial illustration of a mobile web browsing 
functionality employing an embodiment of the present invention; 

Fig. 30 is a simplified pictorial illustration of an interactive mobile 
computing functionality employing an embodiment of the present invention; and 

Fig. 31 is a simplified pictorial illustration of an interactive mobile web 
functionality employing an embodiment of the present invention. 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Reference is now made to Figs. 1 and 2 which together illustrate a data 
input device 1 0 constructed and operative in accordance with a preferred embodiment of 
5 the present invention. 

Data input device 10 preferably includes a light source 12 which 
generates a light beam 14. In accordance with one preferred embodiment of the present 
Invention, light source 12 is a single laser source, such as a monochromatic laser. Color 
and wavelength splitters 15 may be provided to split light from the single laser source. 
10 Alternatively, multiple laser sources 12 having different colors and wavelengths, may 
be employed. Additionally or alternatively, light source 12 may generate differently 
polarized light beams. 

Beam-moving apparatus 16, described more in detail hereinbelow, is 
preferably arranged with respect to light source 12 such that it moves light beam 14 to 
15 generate an optically generated image 18 of a data input device. Image 18 of the data 
input device preferably includes one or more input zones 19 actuable by an action 
performed thereon by a user, as will be readily understood by examples of images 18 
shown in Figs. 3A-3E. In Fig. 3A, an image of a keyboard 20 with keys 22 is generated; 
Keys 22 are the input zones, and a user "presses" keys 22 to input data. The manner in 
20 which the pressing is detected is described hereinbelow. Image 18 may include not only 
the silhouette of keys 22 but also alphanumeric characters 23 formed in the outline of 
each key 22. 

Fig. 3B illustrates another example of an optically generated input 
device, that of a mouse 24, wherein pressing or touching an outlined area of a button 26 

25 performs a "click". Alternatively, moving a user's finger in the outlined area can also 
perform a function. Another example, shown in Fig. 3C, includes an optically generated 
image of a musical instrument 28, such as an organ with keys 30, wherein "pressing" 
keys 30 can generate musical notes. 

In Fig. 3D, an optically generated image of a device such as a cellphone 

30 32, is provided with pad keys 34, wherein "pressing" one of keys 34 can generate 
alphanumeric characters. In Fig. 3E, an optically generated image of palm-held 
computer/calculator/ PDA 36 is provided with keys or buttons 38, wherein "pressing" 
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one of keys or buttons 38 can generate mathematical functions or alphanumeric 
characters. The pad keys 34 or keys 38 are also examples of "virtual" PDA switches that 
can be optically generated. Of course, any suitable kind' of switch can be optically 
generated, such as single-pole and multi-pole switches, for example, . 

5 A sensor is preferably provided to sense the above described actions 

performed on the ihput zone 19. Many kinds of sensors can be employed to detect 
. pressing any of the "virtual" keys of the embodiments shown in Figs. 3A-3E. For 
example, as seen in Fig. 1, the sensor may be an optical sensor 40, such as an electronic 
camera, CCD or position sensing device (PSD), whose field of view encompasses the 

10 "virtual" keyboard or touch pad, etc. Other examples of suitable sensors include an 
acoustic sensor 42 and a position or movement sensor 44. Three acoustic sensors 42. 
should preferably be used for sensing the action by means of triangulation. Any number 
of position or movement sensors can be used, and more than one kind of sensor can be 
employed in carrying out the invention. Other .examples of suitable sensors are 

15 described hereinbelow with reference to Figs. 8-10. 

The sensors, upon sensing the "pressing" or "striking" of the "virtual" 
keys, preferably generate electrical signals based upon the sensed information and 
transmit the signal to a processor 50 which processes and interprets the signals into the 
desired characters, instructions, information and data, input by the user. Processor 50 is 

20 preferably in electrical communication with a device, such as a computer 52, mobile 
telephone 54, musical instrument 56, palm-held computer/calculator 58, and the like, 
which visually or audibly outputs the desired characters, instructions, information and 
data. 

In accordance with a preferred embodiment of the present invention, as 
25 shown in Fig. 4A, beam-moving apparatus 16 includes a mirror array 60 (one or more 
mirrors) arranged to reflect light beam 14, and an actuator, such as a servomotor 62, 
operatively connected to mirror array 60. Servomotor 62 preferably rapidly moves 
mirror array 60 to reflect light beam 14 to form an image of data input device 10. 
Another example is shown in Fig. 4B, wherein beam-moving apparatus 16 includes a 
30 crystal beam modifier 64. Fig. 4C illustrates yet another example of beam-moving 
apparatus 16, that of a scanner 66. In all cases, light beam 14 is rapidly moved to form 
ari image of the data input device 10. Alternatively, a holographic image of data input 
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device 1-0 can be produced by hologramic equipment 65 (Fig. 2). As another alternative, 
an image of data input device 10 can be produced by a grating 67 (Fig. 2). 

Light source 12 and beam-moving apparatus 16 are preferably housed in 
a small laser unit 68 (Fig. 1). This, makes the present invention particularly, 
5 advantageous for mobile 1 communication devices. For example, a user can carry any 
conveniently small size cell phone, for example, plus the small laser unit 68. If the user 
wishes to type messages to be sent to the Internet via the cell phone, for example, the 
user simply generates a large size keyboard with laser unit 68 and comfortably types the 
commands and message, without having to grapple with multiple presses of keys or 

10 with too small keys, or with lugging a clumsy, large keyboard. The present invention 
thus enables user-friendly use of cell phones for communication on the Internet. The 
same holds true for palm-sized computer/calculators, and other small data input devices. 
It is noted that the data input devices 10 of the present invention can not only be used as 
the sole data input device, but can also, be integrated with other conventional or 

15 non-conventional data input devices. 

Although the above described laser unit 68 is considered the most 
preferred embodiment, nevertheless other light units can be used to generate the optical 
image of the data input device. For example, as shown in Fig. 5, a light unit 70 may 
project an optical image 72 of a data input device 74, such as a keyboard, by projecting 

20 light from underneath a transparent 'or translucent substrate 76. A reticle 71 may be 
provided with a template of the keyboard for producing the image 72, for example. The 
sensing of "pressing" the keys of the keyboard and processing signals generated by the 
sensor is preferably as described hereinabove. 

Reference is now made to Fig. 6 wMch illustrates a multilingual 

25 keyboard 80, constructed and operative in accordance with a preferred embodiment of 
the present inventioii. Keyboard 80 is preferably formed by laser unit 68, described 
hereinabove. Laser unit 68 preferably forms a silhouette of keys 82 with alphanumeric 
characters 84 formed in the outline of each key 82. In the embodiment of Fig. 6, a 
linguistic processor 86 is in electrical communication with laser unit 68. Linguistic 

30 processor 86 generates signals for modulating the laser beam from laser unit 68 to form 
letters of any suitable alphabet, as chosen by the user. 

The user can choose the particular language in a number of ways. For 
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example, as shown in Fig. 6, laser unit 68 can first display a standard "qwertyuiop" 
layout of keys 82 in English. The user can then type in English the desired language, 
other than English, whereupon the processor 86 recognizes the desired language and 
signals the laser unit 68 to generate a different set of key patterns 88 and text 84 formed 
5 in the outline of each key 82. 

Additionally or alternatively, switches 90 may be provided for switching 
between languages. It is important to note that the different set of keys 88 does not 
necessarily have the same amount or layout as the standard "qwertyuiop" layout of keys 
82 in English. Linguistic processor 86 is also operative to interpret between the keyed-in 
■ 10 language and any other language in which it is desired to transmit a message. For 
example, a Japanese user interested in a website of a Hungarian company, can 
command laser unit 68 to generate an optical image of a Japanese keyboard, and type a 
message in Japanese. Linguistic processor 86 then translates the Japanese message into 
Hungarian, and directs the translated message to the website. 

15 It is noted that linguistic processor 86 may be locally connected to data 

input device 10, and may be part of its hardware. Alternatively, linguistic processor 86 
can be provided on a remote server, and remotely accessed via the internet. The latter 
feature enables having an international linguistic interface for global communication. 

Reference is now made to Fig. 7 which illustrates that laser unit 68 can 

20 display a non-standard layout of keys 92. In accordance with a preferred embodiment of 
the present invention, the user can modify the arrangement, size and shape of keys 92, 
such as by typing in commands which are interpreted and processed by processor 50 to 
generate the desired arrangement. Additionally or alternatively, switches 94 or other 
hardware may be provided for selecting an arrangement of keys 92 . 

25 Reference is now made to Fig. 8 which illustrates an optical sensor 

system 100 for sensing input of data in any of the. data input devices of the present 
invention, constructed and operative in accordance with a preferred embodiment of the 
present invention. Optical sensing system 100 preferably includes two light beams 102 
and 104, different from light beam 14, to determine the position of the data input. Light 

30 beams 102 and 104 may emanate from light source 12 or from one or more additional 
light sources 106. Light beams 102 and 104 preferably cover the entire area of image 
18, either by means of scanning or by having sufficient beam width to cover the entire 
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area. • 

A pair of light detectors 108 and 110 are preferably provided for 
detecting any light reflected from objects within the silhouette of image 18, 
corresponding to light beams 102 and 104, respectively. For example, as seen in Fig. 
5. 9 A, if no object is in the silhouette of image 18, then light beam 102 is reflected and is 
detected by light detector 108. However, as seen in Fig. 9B, if a finger or other object is 
placed on one of input zones 19 of image 18, then light beam 102 has a new and 
different reflection detected by light detector 108. The same holds true for light beam 
104. By analyzing the reflection of one of the light beams (102 or 104), such as with 

10 processor 50, the system knows the angle relative to the light source at which the object 
lies. By analyzing both of the reflections of light beams 102 and 104 and their 
intersection, the system knows the spatial position of the object. Finally, when the finger 
moves to press the virtual input zone 19, the movement of the finger causes yet another 
different set of reflections of light beams 102 and 104. The new reflections are analyzed 

15 to sense which input zone 19 was "pressed". 

Reference is now made to Fig. 10 which illustrates an optical sensor 
system 120 for sensing input of data in any of the data input devices of the present 
invention, constructed and operative in accordance with another preferred embodiment 
of the present invention. Optical sensing system 120 differs from optical sensing system 

20 100 in that optical sensing system 120 preferably includes one light beam 122 to 
determine the position of the data input. Light beam 122 may emanate from light source 
12 or additional light source 106. Light beam 122 preferably covers the entire area of 
image 1 8, either by means of scanning or by having sufficient beam width to cover the 
entire area. 

25 As seen in Fig. 10, light source 12 or 106 is preferably located at a fixed, 

known distance from a "virtual" keyboard 124. For a given angle, such as angle p, there 
are a plurality of "virtual" keys 126 in the path of light beam 122. The time for light 
beam 122 to impinge on a finger or other object placed on one of keys 126 and be 
reflected back to a light detector 128 is a function of the distance of the key 126 from 

30 light source 12 or 106. For example, the time for light beam 122 to be reflected from 
key 126A may be 60 picoseconds whereas the time for light beam 122 to be reflected 
from key 126B may be 100 picoseconds. Processor 50 preferably analyzes the angle and 
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time data for light beams 122 and derives the spatial position of the finger. Finally, 
when the finger moves to press the particular key, such as key 126, the movement of the 
finger causes a different reflection of light beam 122. The new reflection is analyzed to 
sense which key 126 was "pressed. 1 '. 

Reference is now made to Fig. 11 which illustrates an optical sensor 
system 130 for sensing input of data in any of the data input devices of the present 
invention, constructed and operative in accordance with yet another preferred 
embodiment of the present invention. Optical sensing system 130 is preferably similar 
to the previously described optical sensing system 120, with like elements being 
designated by like numerals. 

In optical sensing system 120, light source 12 or 106 is preferably 
located at a fixed, known distance from keyboard 124 in order to determine the distance 
to the particular finger or object. Optical sensing system 130 differs from optical 
sensing system 120 in that sensing system 130 preferably uses an optically readable 
reference 132, such as a bar code, as a reference for determining the distance to the 
particular finger or object. Optically readable reference 132 may be a tangible bar code 
strip placed on a working surface by the user. Alternatively, optically readable reference 
132 may be optically generated just like keyboard 124. 

For a given angle, such as angle (3, light beam 122 not only crosses over 
a plurality of keys 126, but also impinges upon a particular region of optically readable 
reference 132. The particular place of impingement on optically readable reference 132 
determines the angle of light beam 122. Processor 50 can proceed to analyze the angle 
and time data for light beams 122 and derive the spatial position of the finger, as 
described hereinabove with reference to Figs. 9 A, 9B and 10. 

The embodiments of Figs. 8-11 have been described such that the light 
beams 102, 104 and 122 used to sense the input of data are different from the light beam 
14 used to create the virtual keyboard. Alternatively, with appropriate circuitry or 
software, light beam 14 itself can be used as the light beam used to sense the input of 
data. 

Reference is now made to Fig. 12 which illustrates a sensor system 140 
for sensing input of data in any of the input devices of the present invention, constructed 
and operative accordance with yet another preferred embodiment of the present 
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invention. Sensing system 140 is preferably similar to the previously described optical 
sensing systems 120. and 130, with like elements being designated by like numerals. 
Sensing system 140 differs from the previous optical sensing systems 100, 120 and 130 
in that sensing system 140 preferably includes a non-visible-light beam 142 emanating 
5 from a no.n-visible-light source 143 to determine the position of the data input 
Non-visible-light beam 142 is any beam of electromagnetic wave radiation whose 
wavelength is outside, the range of visible light Alternatively, non-visible-light beam 
142 can be an acoustic beam. Most preferably, beam 142 is an infrared beam. Beam 142 
preferably covers the entire area of image 18, either by means of scanning or by having 

10 sufficient beam width to cover the entire area. . 

Reference is now made to Figs. 13 and 14 which illustrate two typical 
infrared images of fingers placed upon the virtual keyboard 124. Fig. 13 shows an 
infrared image before one of the fingers presses a key 126. Fig. 14 shows an infrared 
image after pressing a key 126. It is seen that the act of pressing changes the blood flow 

15 to and from the tips of the fingers, and thus causes a different infrared image, such as 
seen at reference numeral 146. The difference in the infrared images between Figs. 13 
and 14, is preferably detected by an infrared detector 144 in electrical communication 
with processor 50. Processor 50 preferably analyzes the differences in the images and 
determines which key 126 was pressed. 

20 When creating and projecting images of any of the input devices of the 

present invention, it is possible that portions of the image may fall upon fingers of the 
user. Although this does not affect the operation of the invention, nevertheless some 
users may desire that no portion of . the image fall on their fingers. Reference is now 
made to Fig. 15 which illustrates a method for prieventing displaying image of a data 

25 input device oh selected locations, in accordance with another preferred embodiment of 
the present invention. 

As described hereinabove, beam-moving apparatus 16 is arranged with 
respect to light source 12 such that it moves light beam 14 to generate generated image 
18 of the data input device. Any of the above-described sensor systems 100, 120, 130 or 

30 140 scans the image 1 8 to detect data input as described hereinabove. The sensor system 
also detects the presence of an object, e.g., a hand or finger, in the outline of image 18: 
Since processor 50 knows the position of the hand or finger, as well as the position of 



20 



WO 01/93182 



PCT/IL01/00480 



light beam 14, processor 50 can instruct moving apparatus 16 and source 12 to cause 
light beam 14 to generate the image 18 only in those regions not covered by the fingers. 

It is noted that any of the above-described sensor systems 100, 120, 130 
or 140 can be used to detect data input and : the like even without being used in 
conjunction with the generation of image 18. For example, any of the sensor systems of 
the invention can be used to detect finger movement on a "regular", tangible keyboard. 

Reference is now made to Figs. 16 and 17 which illustrate other 
examples of applications generating images of data input devices in accordance with 
preferred embodiments of the present invention. In Fig. 16, a light-generated web page 
is generated with any of the above-described apparatus for generating images of data 
input devices. A user can input data by "clicking" on a click zone 148, the click being 
detected as described hereinabove. 

In Fig. 17, a light-generated game object 150, such as a chess piece 152 
and chess board 154 are generated with any of the above-described apparatus for 
generating images of data input devices. A user can input data related to the game, such 
as "moving" the chess piece 152, with the input being detected as described 
hereinabove. 

As mentioned hereinabove, laser unit 68 is considered the most preferred 
embodiment, but other light units can be used to generate the optical image of the data 
input device. Another example is shown in Fig. 18, mirror array 60 (described 
hereinabove with reference to Fig. 4A) may include a mirror 160 with a darkened 
portion 162 that does not reflect light, and clear portions 164 which do reflect light. The 
clear portions 164 are shaped like characters, numerals, letters or any other shape which 
it is desired to form a light-generated image 1 66 thereof. 

Reference is now made to Fig. 19, which is a simplified pictorial 
illustration of a mobile telephone or other suitable mobile communicator, referred to 
collectively as a mobile telephone, including a projected keyboard functionality in 
accordance with a preferred embodiment of the present invention. 

As seen in Fig. 19, a modified mobile telephone 200, such as a cellular 
telephone may be modified to include a projector 202, which is capable of projecting an 
image 204 of at least part of a keyboard onto an inert surface 206, such as a desktop. At 
least one sensor 208, such as a CCD or CMOS camera mounted on mobile telephone 
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200, senses user indicator interaction with specific locations on the image 204 of at least 
part of the keyboard. Preferably, at least alpha-numeric information generation circuitry 
210 is provided within mobile telephone 200 and employs an output from the at least 
one sensor 208 for providing an at least alpha-numeric output to utilization circuitry 210 
5 which may be located within the telephone 200 or remote therefrom. 

In accordance with a preferred embodiment of the present invention, 
there is provided in operative association with at least one sensor 208, at least one 
infra-red illuminator 212, directing infra-red radiation over the image 204 of at least part 
of the keyboard 204 onto the inert surface 206. In this case, the at least one sensor 
10 includes at least one infra-red sensor for sensing infra-red light scattered from at least 
one user indicator (not shown). 

Reference is now made to Fig. 20, which is a simplified pictorial 
illustration of a personal digital assistant including a projected keyboard functionality in 
accordance with a preferred embodiment of the present invention. 
15 As seen in Fig. 20, a modified personal digital assistant 220, such as a 

PALM PILOT® may be modified to include a projector 222, which is capable of 
projecting an image 224 of at least part of a keyboard and a mouse functionality onto 
an inert surface 226, such as a desktop. At least one sensor 228, such as a CCD or 
CMOS camera, mounted on personal digital assistant 220, senses user indicator 
20 interaction with specific locations on the image 224 of at least part of the keyboard and 
the mouse functionality. 

Preferably, at least alpha-numeric information generation circuitry 230 is 
provided within personal digital assistant 220 and employs an output from the at least 
one sensor 228 for providing an at least alpha-numeric output to utilization circuitry 
25 which may be located within the personal digital assistant 220 or remote therefrom. 

In accordance with a preferred embodiment of the present invention, 
there is provided in operative association with at least one sensor 228, at least one 
infra-red illuminator 232, directing infra-red radiation over the image 224 of at least part 
of the keyboard onto the inert surface 226. In this case, the at least one sensor 228 
30 includes at least one infra-red sensor for sensing infra-red light scattered from at least 
one user indicator (not shown). 

Reference is now made to Fig. 21, which is a simplified pictorial 
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illustration of projection, illumination and detection functionality useful in the 
embodiments of Figs. 19 and 20 and to Figs. 22, 23 and 24 which show more details 
thereof. 

As seen in Figs. 21 and 22, in a modified mobile device 250, such as 
5 modified telephone 200 (Fig. 19) or a modified personal digital assistant 220 (Fig. 20), a 
projector 252, such as projector 202 (Fig. 19) or projector 222 (Fig. 20) preferably 
includes a solid state point light source 254 which illuminates a mask 256 which defines 
an image 258 of a keyboard and a mouse functionality, preferably including a touchpad 
284 and a pair of click buttons 286 and 288, preferably via a negative lens 260. A 
10 mirror 262 preferably directs light that has passed through mask 256 onto a projection 
surface 264, preferably an inert surface, such as a desktop. It is noted that the natural 
astigmatism of a diode laser light source may be used to advantage in order to obviate 
the need for a condensing lens upstream of mask 256. 

Mask 256 may be any suitable type of mask and is preferably designed to 
15 be pre-distorted, as shown in Fig. 25 in order to compensate for optical distortions in 
projection and to enable a generally distortion free image of a keyboard to be projected 
onto an inert surface. 

As seen in Figs. 21 and 23, in modified mobile device 250, an 
illuminator 272, such as illuminator 212 (Fig. 19) or illuminator 232 (Fig. 20) 
20 preferably includes a solid state light source 274 which directs light via a focusing lens 
276 and a mirror 278 onto a cylindrical reflecting element 280, which preferably 
produces radially directed illumination 283 about a longitudinal axis 281 of the 
cylindrical reflecting element 280. The radially directed illumination 283 extends over 
approximately 180 degrees, generally in a plane generally parallel to the projection 
25 surface 264. It is appreciated that the radially directed illumination 283 has a very 
narrow spread in the direction generally perpendicular to the projection surface 264. It is 
further appreciated that the radially directed illumination 283 is located very close to the 
surface of the projection surface 264. 

Impingement of the radially directed illumination 283 on a stylus 282 or 
30 other use implement or appendage causes light to be scattered or reflected therefrom. It 
is appreciated that the light is only reflected when the stylus is in close contact with the 
keyboard 224. 
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As seen -in Figs. 20, 21, 22 and 24, the mouse functionality, which may 
also have applicability in all suitable embodiments -of the present invention, typically 
includes a virtual touch pad 284 and virtual right and left click buttons 286 and 288. It 
is appreciated that the present invention thus provides full mouse and touchpad 
5 functionality. ' 

As seen in Figs. 21 and 24, in modified mobile device 250, a detector 
292, such as detector 208 (Fig. 19) or detector 228 (Fig. 20) preferably includes a CCD 
camera such as a Sony ICX409AL, a CMOS camera, such as an Omnivision OV7110, a 
position sensitive detector, such as a Hamamastsu SI 880 an array of CCD or CMOS 

10 detectors, a 'series of line detectors, each aligned to view a line of the projected, 
keyboard, or any other suitable detector. 

Detector 292 receives light reflected or scattered from stylus 282 
preferably via an imaging lens 294 and a filter 296, such as an IR filter. The imaging 
lens 296 maps the keyboard 224 onto the detector 292. Thus, each point of the keyboard 

15 224 is defined by a given area on the detector 292. An output of detector 292 is supplied 
to information generation circuitry 298, such as information generation circuitry 210 
(Fig. 19) and information generation circuitry 230 (Fig. 20). The information generation 
circuitry 298 determines the location of the source of the reflected or scattered light 299 
thus defining the location of the stylus 282 on the keyboard 224. The location of the 

20 stylus 282 indicates which key of the keyboard 224 is being pressed. 

Reference is now made to Fig. 26, which is a somewhat more detailed 
illustration of the detection functionality of Fig. 21 in accordance with another 
preferred embodiment of the present invention and providing detection in three 
dimensions. As seen in Fig. 26, a scanning mirror 300 reflects a line of light 301 

25 produced by a line light source 302 so as to sweep the reflected light 304 into a plane 
generally perpendicular to the plane of the reference surfaces 306, thus covering a 
volume 305. A preferable sweep direction is shown by an arrow 307 in Fig. 26. Fig. 26 
also shows the reflected light 304 in three different angular orientations with respect to a 
reference surface 306. 

30 It is appreciated that the line light source 302 may be identical to the 

illuminator 272 described hereinabove with respect to Figs. 21 and 23. 

A detector 308, which may be identical to detector 292 (Fig. 24) receives 
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light reflected or scattered from a stylus 310. In the embodiment of Fig. 26, the output 
of detector 308 and a position indicating output from the scanning mirror 300 are 
supplied to 3-D position calculation circuitry 312, which correlates the detection of the 
stylus with the position of the light plane 304. X and Y coordinates of the position of 

5 the stylus 3 1 0 are determined from the output of the detector 308 while the Z position of 
the tip of the stylus is determined from the position of the scanning mirror 300 when the 
light from the stylus is first detected. In this way, the location of the tip of the stylus 
may be determined to a desired degree of accuracy notwithstanding that the stylus is not 
in contact with a reference surface, such as surface 306. 

10 Reference is now made to Fig. 27, which is a somewhat more detailed • 

illustration of the projection functionality of Fig. 21 in accordance with another 
preferred embodiment of the present invention. As seen in Fig. 27, a projector 320, such 
as projector 202 (Fig. 19) or projector 222 (Fig. 20) preferably includes a solid state 
point light source 322 which illuminates a diffractive optical element 324, which 

1 5 defines an image 326 of a keyboard, preferably via a lens (not shown). 

Reference is now made to Fig. 28, which is a somewhat more detailed 
illustration of the projection functionality of Fig. 21 in accordance with yet another 
preferred embodiment of the present invention and providing dynamic projection. As 
seen in Fig. 28 one or more solid state light sources 332 direct light through a 

20 condensing lens 334 onto a dynamic mask 336, such as a spatial light modulator, which 
receives a modulating input from an image generator 338. 

The dynamically modulated light output from dynamic mask 336 passes 
through a projection lens 340 and preferably is reflected by a mirror 342 onto a surface 
344, thereby defining an image 346 of a keyboard on surface 344. It is appreciated that 

25 the image of the keyboard may be varied by changing the modulation of the dynamic 
mask 336, to accommodate different fonts, languages or specific user requirements and 
to provide a selectable and variable touch screen. In this manner a user interface may be 
partially or entirely provided using the projected image provided using the dynamic 
mask 336. 

30 Reference is now made to Fig. 29, which is simplified pictorial 

illustration of a mobile web browsing functionality employing an embodiment of the 
present invention. As seen in Fig. 29, a suitably equipped mobile communicator, such as 
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a mobile telephone 400 which is equipped with a projector, similar to the telephone 
shown in Fig. 19 and projector shown in Figure 28 and described hereinabove, may be 
used to project an image 402 of a web page onto a suitable projection surface, such as a 
wall. This provides ease of reading the web page which otherwise might not be legible 
5 in its usual HTML format on a display 404 built into the telephone 400. In this way, 
special formatting of web pages for mobile telephone web access may be obviated. 

Reference is now made to Fig. 30, which is a simplified pictorial 
illustration of an interactive mobile computing functionality employing an embodiment 
of the present invention. As seen in Fig. 30, a mobile communicator 410, such as a 

10 personal digital assistant or a pocket PC, such as the PDA shown in Fig. 20 and 
described hereinabove, may be used both to display content at a display location 412 
and to enable user input via a virtual keyboard 414 projected thereby. A typical 
functionality for this embodiment may be a wireless system for email communication. 

Reference is now made to Fig. 31, which is a simplified pictorial 

15 illustration of an interactive mobile web functionality employing another embodiment 
of the present invention. As seen in Fig. 31, a mobile communicator 420, such as a 
personal digital assistant or a mobile telephone, such as the PDA shown in Fig. 20 or 
the telephone shown in Fig. 19, both of which are described hereinabove, may be used 
both to interactively display content at a display location 422, such as via a virtual touch 

20 screen 424 and to enable user input via the virtual touch screen 424. It is appreciated 
that the virtual touch screen 424 may be provided by at least partial overlap between 
regions of projection and detection using apparatus such as that described hereinabove 
in the context of a. virtual keyboard, for example in Figs. 21 - 28. In this application, the 
image of a standard keyboard is replaced by a touch screen type image. It is appreciated 

25 that the dynamic projection arrangement of Fig. 28 is particularly suitable for this 
application. A typical functionality for this embodiment may be a wireless system for 
mobile commerce communication. 

It will be appreciated by persons skilled in the ayt that the present 
invention is not limited by what has been particularly shown and described hereinabove. 

30 Rather the scope of the present invention includes both combinations and sub 
combinations of the features described hereinabove as well as modifications and 
variations thereof which would occur to a person of skill in the art upon reading the 
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foregoing description and which are not in the prior art. 
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CLAIMS • 

What is claimed is: • 

1* Apparatus for inputting at least alpha-numeric information into a 

computer comprising: 

5 a projector, projecting an image of at least part of a keyboard onto an 

inert surface; 

at least one sensor, sensing user indicator interaction with specific 
locations on said image of at least part of a keyboard; and 

at least alpha-numeric information generation circuitry . employing an 
10 output from said at least one sensor for providing an at least alpha-numeric output. 

.2.. Apparatus according to claim 1 and also comprising a wireless 

communicator operative to provide said at least alpha-numeric output in a wireless 
manner to a receiver. 

15 

3. Apparatus according to claim 2 and wherein said wireless communicator 

comprises a cellular telephone. 

4 - Apparatus according to claim 3 and wherein said cellular telephone 

20 includes a housing, in which housing are mounted said projector, said at least one sensor 
and said at least alpha-numeric information generation circuitry. 

5. Apparatus according to claim 1 and also comprising comprises a 
personal digital assistant. 

25 

6. Apparatus according to claim 2 and wherein said personal digital 
assistant includes a housing, in which housing are mounted said projector, said at least 
one sensor and said at least alpha-numeric information generation circuitry. 

30 7. Apparatus according to claim 1 and wherein said at least one sensor 

comprises at least one infra-red illuminator, directing infra-red radiation over said image 
of at least part of a keyboard onto an inert surface and at least one infra-red sensor for 
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sensing infra-red light scattered from at least one user indicator. 

8. Apparatus according to claim 2 and wherein said at least one sensor 
comprises at least one infra-red illuminator, directing infra-red radiation over said image 

5 of at least part of a keyboard onto an inert surface and at least one infra-red sensor for 
sensing infra-red light reflected from at least one user indicator. . 

9. Apparatus according to claim 3 and wherein said at least one sensor 
comprises at least one visible light illuminator, directing visible radiation over said 

10 image of at least part of a keyboard onto an inert surface and at least one visible 
radiation sensor for sensing visible light scattered from at least one user indicator. 

10. Apparatus according to claim 4 and wherein said at least one sensor 
comprises at least one visible light illuminator, directing visible radiation over said 

15 image of at least part of a keyboard onto an inert surface and at least one visible 
radiation sensor for sensing visible light reflected from at least one user indicator. 

1 1 . Apparatus according to claim 1 and wherein said user indicator is a user 
finger. 

20 

12. Apparatus according to claim 1 and wherein said user indicator is a user 
held stylus. 

13. Apparatus according to claim 1 and wherein said projector comprises a 
25 point light source illuminating a mask defining said image of at least part of a keyboard. 

14. Apparatus according to claim 13 and also comprising a mirror directing 
light passing through said mask onto, said inert surface. 

30 15. Apparatus according to claim 13 and also comprising at least one lens 

directly light from said point source through said mask. 
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16. Apparatus according to claim 13 and wherein said point light source 
comprises a diode laser. 

17. Apparatus according to claim 13 and wherein said mask is formed to 
5 define a distorted representation of said image of said at least part of a keyboard in order 

to compensate for distortions in said projector. 

18. Apparatus according to claim 1 3 and wherein said mask is a dynamically 
changeable mask. 

10 

19. Apparatus according to claim 7 and wherein said infra-red illuminator 
comprises a cylindrical reflecting element receiving light from a point source and 
producing a generally flat, generally radially-directed light distribution. 

15 20. Apparatus according to claim 8 and wherein said infra-red illuminator 

comprises a cylindrical reflecting element receiving light from a point source and 
producing a generally flat, generally radially-directed light distribution. 

21. Apparatus according to claim 9 and wherein said visible radiation 
20 illuminator comprises a cylindrical reflecting element receiving light from a point 

source and producing a generally flat, generally radially-directed light distribution. 

22. Apparatus according to claim 10 and wherein said visible radiation 
illuminator comprises a cylindrical reflecting element receiving light from a point 

25 source and producing a generally flat, generally radially-directed light distribution. 

23. Apparatus according to claim 1 and wherein said at least one sensor 
comprises an array of discrete sensing elements and at least one lens operative to image 
a region overlying each of a plurality of keyboard locations onto a corresponding at 

30 least one of said array of discrete sensing elements. 

24. Apparatus according to claim 1 and wherein said at least one sensor 
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comprises an a position sensitive detector and at least one lens operative to image a 
region overlying each of a plurality of keyboard locations onto a corresponding region 
on said position sensing detector. 

5 25. Apparatus according to claim 7 and wherein said at least one infra-red 

illuminator is operative to direct infra-red radiation at a plurality of levels over said 
image of at least part of a keyboard and said at least one infra-red sensor is operative to 
sense infra-red light scattered from at least one user indicator at a plurality of locations 
therealong. 

10 

26. Apparatus according to claim 8 and wherein said at least one infra-red 
illuminator is operative to direct infra-red radiation at a plurality of levels over said 
image of at least part of a keyboard and said at least one infra-red sensor is operative to 
sense infra-red light reflected from at least one user indicator at a plurality of locations 

15 therealong. 

27. Apparatus according to claim 9 and wherein said at least one visible 
radiation illuminator is operative to direct visible radiation at a plurality of levels over 
said image of at least part of a keyboard and said at least one visible radiation sensor is 

20 operative to sense visible radiation light scattered from at least one user indicator at a 
plurality of locations therealong. 

28. Apparatus according to claim 10 and wherein said at least one visible 
radiation illuminator is operative to direct visible radiation at a plurality of levels over 

25 said image of at least part of a keyboard and said at least one visible radiation sensor is 
operative to sense visible radiation light reflected from at least one user indicator at a 
plurality of locations therealong. 

29. Apparatus according to claim 1 and wherein said projector comprises a 
30 diffractive optical element, which when illuminated produces said image of at least part 

of a keyboard onto said inert surface. 
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30. Apparatus according to claim 1 and wherein said projector comprises a 

spatial light modulator, which when illuminated produces said " image of at least part of 
a keyboard onto' said inert surface. . 

5 31.. Apparatus according to claim 30 and wherein said spatial light modulator 

comprises a dynamic spatial light modulator which is responsive to an electrical input 
for producing a dynamic image onto said inert surface. 

32, Apparatus according to claim 1. and wherein: 

10 said projector protects an image of at least part of a keyboard and of 

mouse functionality onto said inert surface; and 

said at least one sensor senses user indicator interaction with specific 
locations on said image of said mouse functionality. 

15 33. Apparatus for inputting at least cursor-control information into a 

computer comprising: 

a projector, projecting an image of at least part of mouse functionality 
onto an inert surface; 

at least one sensor, sensing user indicator interaction with specific 
20 locations on said image of at least said mouse functionality; and 

at least cursor control information generation circuitry employing an 
output from said at least one sensor for providing an at least a cursor control output. 

34. A wireless system for web browsing comprising: 

25 a wireless communicator providing web browsing functionality: and 

at least one projector mounted on said wireless communicator and 
projecting an image of a display onto a surface. 

35. A wireless system for web browsing comprising: 

30 a wireless communicator providing web browsing functionality: 

at least one projector mounted on said wireless communicator and 
projecting an image of at least part of a keyboard onto a surface. 
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36. A wireless system for web browsing comprising: 

a wireless communicator providing web browsing functionality: 

at least one projector mounted on said wireless communicator and 
projecting an image of at least part of a keyboard onto a surface; 

at least one sensor, sensing user indicator interaction with specific 
locations on said image of at least part of a keyboard; and 

at least alpha-numeric information generation circuitry employing an 
output from said at least one sensor for providing an at least alpha-numeric output. 

37. A wireless system for web browsing according to claim 36 and wherein 
said projector is also operative for projecting an image of a display onto a surface, 
whereby a user may readily view images produced during web browsing. 



15 38. A wireless system for web browsing according to claim 37 and also 

comprising: 

at least one sensor, sensing user indicator interaction with specific 
locations on said image of said display; and 

web browsing input circuitry employing an output from said at least one 
20 sensor for providing an at least one web browsing output based on user implement 
actuation of locations on said image of said display corresponding to web links. 

39. A wireless system for email communication comprising: 

a wireless communicator providing email communication functionality: 

25 and 

at least one projector mounted on said wireless communicator and 
projecting an image of a display onto a surface. 

40. A wireless system for email communication comprising: 

30 a wireless communicator providing e mail communication functionality: 

at least one projector mounted on said wireless communicator and 
projecting an imaige of at least part of a keyboard onto a surface. 
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41. A wireless system for e mail communication comprising: 

a wireless communicator providing e mail communication functionality: 

at least one projector mounted on said wireless communicator and 
projecting an image of at least part of a keyboard onto a surface; 

at least one sensor, sensing user indicator interaction with specific 
locations on said image of at least part of a keyboard;, and 

at least alpha-numeric information generation circuitry employing an 
output from said at least one sensor for providing an at least alpha-numeric output. 

42. A wireless system for e mail communication according to claim 41 and 
wherein said projector is also operative for projecting an image of a display onto a 
surface, whereby a user may readily view messages during e mail communication. 

43. A wireless system for e mail communication according to claim 42 and 
also comprising: 

at least one sensor, sensing user indicator interaction with specific 
locations on said image of said display; and 

email communication input circuitry employing an output from said at 
least one sensor for providing an at least one e mail communication output based on 
user implement actuation of locations on said image of said display. 

44. A wireless system for mobile commerce communication comprising: 

a wireless communicator providing mobile commerce communication 
functionality; and .' 

at least one projector mounted on said wireless communicator and 
projecting an image of a display onto a surface. 

45. A wireless system for mobile commerce communication comprising: 

a wireless communicator providing mobile commerce communication 

functionality: 

at least one projector mounted on said wireless communicator 
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and projecting an image of at least part of a keyboard onto a surface. 

46. A wireless system for mobile commerce communication comprising: 

a wireless communicator providing mobile commerce communication 

5 functionality: 

at least one projector mounted on said wireless communicator 
and projecting an image of at least part of a keyboard onto a surface; 

at least one sensor, sensing user indicator interaction with specific 
locations on said image of at least part of a keyboard; and 
10 at least alpha-numeric information generation circuitry 

employing an output from said at least one sensor for providing at least an mobile 
commerce communication output. 

47. A wireless system for mobile commerce communication according to 
15 claim 46 and wherein said projector is also operative for projecting an image of a 

display onto a surface, whereby a user may readily view images produced during mobile 
commerce communication. 

48. A wireless system for mobile commerce communication according to 
20 claim 47 and also comprising: 

at least one sensor, sensing user indicator interaction with specific 
locations on said image of said display; and 

mobile commerce communication input circuitry employing an output 
from said at least one sensor for providing an at least one mobile commerce 
25 communication output based on user implement actuation of locations on said image of 
said display corresponding to web links. 

49. A method for inputting at least alpha-numeric information into a 
computer comprising: 

30 projecting an image of at least part of a keyboard onto an inert surface; 

sensing user indicator interaction with specific locations on said image 
of at least part of a keyboard; and 
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employing an output indicating sensed user indication interaction for 
providing an at least alpha-numeric output 

50: A method according to claim 49 and also comprising providing said at 

5 least alpha-numeric output in a wireless manner to a receiver. 

51. A method according to claim 49 and wherein said sensing comprises 
directing infra-red radiation over said image of at least part of a keyboard on an inert 
surface and sensing infra-red light scattered from at least one user indicator. 

10 

52. A method according to claim 49 and wherein said sensing comprises 
directing visible radiation over said image of at least part of a keyboard on an inert 
surface and sensing visible light scattered from at least one user indicator. 

15 53. A method according to claim 49 and wherein said user indicator is a user 

finger. 

54. A method according to claim 49 and wherein said user indicator is a user 
held stylus. 

20 

55. A method according to claim 51 and wherein said directing comprises 
reflecting light from a point source and producing a generally flat, generally 
radially-directed light distribution. 

25 56. A method according to claim 52 and wherein said directing comprises 

reflecting light from a point source and producing a generally flat, generally 
radially-directed light distribution. 

57. A method according to claim 49 and wherein said sensing comprises 

30 employing an array of discrete sensing elements and imaging a region overlying each of 
a plurality of keyboard locations onto a corresponding at least one of said array of 
discrete sensing elements. 
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58. A method according to claim. 49 and wherein said sensing comprises 
position sensitive detecting and imaging . of a region overlying each of a plurality of 
keyboard locations onto a corresponding region on said position sensing detector. 

5 

59. A method according to claim 5 land wherein said directing includes 
directing infra-red radiation at a plurality of levels over said image of at least part of a 
keyboard and said infra-red sensing includes sensing infra-red light scattered from at 
least one user indicator at a plurality of locations therealong. 

10 

60. A method according to claim 52 and wherein said directing includes 
directing visible radiation at a plurality of levels over said image of at least part of a 
keyboard and said visible sensing includes sensing visible light scattered from at least 
one user indicator at a plurality of locations therealong. 

15 

61. A method according to claim 49 and wherein said projecting comprises 
illuminating a diffractive optical element to produce said image of at least part of a 
keyboard onto said inert surface. 

20 62. A method according to claim 49 and wherein said projecting comprises 

illuminating a spatial light modulator to produce said image of at least part of a 
keyboard onto said inert surface. ' 

63. A method according to claim 62 and wherein said projecting comprises 
25 illuminating a dynamic spatial light modulator which is responsive to an electrical input 

for producing a dynamic image onto said inert surface. 

64. A method for wireless web browsing comprising: 
providing web browsing functionality: and 

30 projecting an image of a display related to said functionality onto a 

surface. 
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65. A method for wireless web browsing comprising: 
providing web browsing functionality: and 

projecting an image of at least part of a keyboard onto a surface for use 
with said web browsing functionality. 
5 ... 

66. A method for wireless web browsing comprising: 
providing web browsing functionality: 

projecting an image of at least part of a keyboard onto a surface; 
sensing user indicator interaction with specific locations on said image of 
1 0 at least part of a keyboard; and 

generating an output useful in said web browsing functionality from said 
sensing for providing an at least alpha-numeric output 

67. A method for wireless web browsing according to claim 66 and wherein 
15 said projecting comprises projecting an image of a display onto a surface, whereby a 

user may readily view images produced during web browsing. 

■ i ■ " ■ • 

I 

68. A method for wireless web browsing according to claim 67 and also 
comprising: ....... 

20 sensing user indicator interaction with specific locations on said image of 

said display; and 

employing an output from said sensing for providing an at least one web 
browsing output based on user implement- actuation of locations on said image of said 
display corresponding to web links. 

25 

69. A method for wireless e mail communication comprising: 
providing e mail communication functionality: and 

projecting an image of a display onto a surface for use in said 
communication functionality. 

30 

70. A method for wireless e mail communication comprising: 
providing e mail communication functionality; and 



38 



WO 01/93182 



PCT/EL01/00480 



projecting an image of at least part of a keyboard onto a surface for use 
in said communication functionality. 

71. A method for wireless e mail communication comprising: 
5 providing e mail communication functionality; 

projecting an image of at least part of a keyboard onto a surface; 
sensing user indicator interaction with specific locations on said image of 
at least part of a keyboard; and 

generating an output from said at least one sensor for providing an at 
10 least alpha-numeric output useful in said communication functionality. 

72. A method for wireless e mail communication according to claim 71 and 
wherein said projection comprises projecting an image of a display onto a surface, 
whereby a user may readily view messages during e mail communication. 

15 

73. A method for wireless e mail communication according to claim 72 and 
also comprising: 

sensing user indicator interaction with specific locations on said image of 
said display; and 

20 employing an output from said sensing for providing an at least one e 

mail communication output based on user implement actuation of locations on said 
image of said display. 

74. A method for wireless mobile commerce communication comprising: 
25 providing mobile commerce communication functionality: and 

projecting an image of a display onto a surface for use in said 
communication functionality. 

75. A method for wireless mobile commerce communication comprising: 
30 providing mobile commerce communication functionality; and 

projecting an image of at least part of a keyboard onto a surface. 
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76. A method for wireless mobile commerce communication comprising: 
providing mobile commerce communication functionality; 
projecting an image of at least part of a keyboard onto a surface; 
sensing user indicator interaction with specific locations on said image of 

5 at least part of a keyboard; and 

generating an output from said at least one sensor for providing at least 
an mobile commerce communication output. 

77. A method for wireless mobile commerce communication according to 
10 claim 76 and wherein said projection comprises projecting an image of a display onto a 

surface, whereby a user may readily view images produced during mobile commerce 
communication. 

78. A method for wireless mobile commerce communication according to 
15 claim 77 and also comprising: 

sensing user indicator interaction with specific locations on said image of 
said display; and 

employing an output from said sensing for providing an at least one 
mobile commerce communication output based on user implement actuation of 
20 locations on said image of said display corresponding to web links. 

79. A method according to claim 49 and wherein: 

said projection projects an image of at least part of a keyboard and of 
mouse functionality onto said inert surface; and 
25 said sensing senses user indicator interaction with specific locations on 

said image of said mouse functionality. 

80. A method for inputting at least cursor-control information into a 
computer comprising: 

30 projecting an image of at least part of mouse functionality onto an inert 

surface; 

sensing user indicator interaction with specific locations on said image of 
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at least said mouse functionality; and 

generating an output from said at least one sensor for providing an at 
least a cursor control output. 

5 81. A data input device comprising: 

an optically generated image of a data input device, said image 
comprising at least one input zone actuable by an action performed thereon by a user; 

a sensor operative to sense the action performed on said at least one input 
zone, and to generate signals in response to said action; and 
10 a processor in communication with said sensor operative to process said 

signals for performing an operation associated with said at least one input zone. 

82. The device according to claim 81 and further comprising a light source 
which generates a light beam, and beam-moving apparatus which moves said light beam 

15 to generate said optically generated image of said data input device. 

83. The device according to claim 82 wherein said beam-moving apparatus 
comprises a mirror arranged to reflect said light beam. 

20 84. The device according to claim 83 and further comprising an actuator 

operatively connected to said mirror, wherein said actuator moves said mirror to reflect 
said light beam to form at least a two-dimensional image of said data input device. 

85. The device according to claim 82 wherein said beam-moving apparatus 
25 comprises a scanner arranged to scan said light beam, and an actuator operatively 

connected to said scanner, wherein said actuator moves said scanner to scan said light 
beam to form at least a two-dimensional image of said data input device, 

86. The device according to claim 81 wherein said data input device 
30 comprises a key of a keyboard. 

87. The device according to claim 81 wherein said data input device 
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comprises a keyboard. 

88. The device according to claim 81 wherein said data input device 
comprises a mouse with at least one input button. 

5 

89. The device according to claim 81 wherein said data input device 
comprises a key of a touch pad. 

90. The device according to claim 81 wherein said sensor comprises an 
10 optical sensor. ... 

91 . The device according to claim 90 wherein said optical sensor comprises 
a CCD. 

15 92. The device according to claim 90 wherein said optical sensor comprises 

a position sensing device (PSD). 

93. The device according to claim 81 wherein said sensor comprises an 
acoustic sensor. 

20 

94. The device according to claim 81 wherein said sensor comprises a 
movement sensor. 

95. The device according to claim 81 wherein said processor is in 
25 communication with an output device. 

96. The device according to claim 95 wherein said output device comprises 
at least one of a computer, a mobile telephone, a switch, and a palm-held 
computer/calculator. 

30 

97. A method for data input comprising: 

generating an optical image of a data input device, said image 
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comprising at least one input zone actuable by an action performed thereon by a user; 
performing an action on said at least one input zone; 
sensing the action performed on said at least one input zone; 
generating signals in response to said action; and 

processing said signals for performing an operation associated with said 
at least one input zone. 

98. , The method according to claim 97 wherein the step of generating the 

optical image comprises generating an image of a keyboard and the step of performing 
an action comprises pressing keys of said image of said keyboard. 

99. The method according to claim 98 wherein the step of processing said 
signals causes typing alphanumeric characters on at least one of a computer, cell phone, 
palm-sized computer/calculator and PDA. 

1 00. The method according to claim 98 and further comprising modifying said 
image of said keyboard so as to modify a configuration of keys of said keyboard. 

101. The method according to claim 98 and further comprising: 

optically generating an image of characters of a first language on keys of 

said keyboard; . 

selecting a second language different from said first language; and 
optically generating an image of characters of said second language on 

keys of said keyboard. 

102. The method according to claim 97 wherein said optical image of said 
data input device is a holographic image. 

103. The method according to claim 97 wherein said optical image of said 
data input device is generated by means of a monochromatic laser. 



The method according to claim 97 wherein said optical image of said 
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data input device is generated by means of multiple laser sources having different colors 
and wavelengths. 

105. The method according to claim 97 wherein said optical image of said 
5 data input device is generated by means of a single laser source and using color and 

wavelength splitters to split light from said single laser source. 

106. The method according to claim 97 wherein said optical image of said 
data input device is generated by means of differently polarized light beams. 

10' 

107. The method according to claim 97 wherein the step of sensing 
comprises: 

detecting light reflected from an object within a silhouette of said image; 

and 

15 analyzing a reflection of said light to determine a spatial position of the 

object. 

108. The method according to claim 97 wherein the step of sensing 
comprises: 

20 , s providing a light beam emanating from a light source; 

detecting light reflected from an object within a silhouette of said image, 
• corresponding to said light beam; and 

analyzing an angle of said light beam and a time for the beam to be 
reflected back from said object to a reference to determine a spatial position of the 
25 object. 

109. The method according to claim 108 wherein said reference comprises an 
optically readable reference. 

30 110. The method according to claim 109 wherein said optically readable 

reference comprises a tangible bar code strip. 
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111. The method according to claim 109 wherein said optically readable 
reference comprises an optically generated bar code strip. 

112. The method according to claim 108 wherein said optical image of a data 
5 input device is generated by the same light beam whose reflection is used to determine 

the spatial position of the object. 

113. The method according to claim 97 wherein the step of sensing 
comprises: 

10 providing a non-visible-light beam emanating from a non-visible light 

source; 

detecting an image of said non-visible light impinging upon an object 
within a silhouette of said image of the data input device; and 

analyzing said image of said non-visible light to determine a spatial ' 
15 position of the object. 

1 14. The method according to claim 1 13 wherein said non-visible light beam 
comprises an infrared beam and said image of said non-visible light comprises an 
infrared image of said object. 

20 

1 1.5- The method according to claim 97 and further comprising detecting light 

reflected from an object within a silhouette of said image and, pre venting said image 
from impinging upon said object. 
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